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ABSTRACT 

In this paper we will derive the equilibrium distribution of states of a model containing four different types of 
service centers and R different classes of customers. From this steady state distribution one can compute the moments of 
the queue sizes for different classes of customers at different service centers, the utilizations of the service centers, the 
“cycle time” or response time for different classes of customers, the “throughput” of different classes of customers, and 
other measures of system performance. 
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INTRODUCTION 

These results unify and extend a number of separate results on networks of queues. The general model can have 
four types of service centers. Three of those types allow different service time distributions with rational Laplace 
transforms for different classes of customers. The model allows different classes of customers to have different arrival rates 
and different routing probabilities. For open networks some very simple formulas give the marginal distribution of 
customers at the service centers of the network. 

The analysis is motivated by the desire to model computer systems. Type one service centers (FCFS scheduling) 
seem appropriate models of secondary storage input/output devices. Type two service centers (processor sharing 
scheduling) can be an appropriate model for central processing units. Type three service centers, (no queueing) are 
appropriate models for, terminals and for routing delays in the network. 

The requirement that a service time distribution have a rational Laplace Transform is not very restrictive. 
Exponential, hyperexponential and hypoexponential distributions all have rational Laplace Transforms. Cox [12] has 
shown that any such distribution can be represented by a network of exponential stages of the form illustrated in Fig. 1. For 
convenience, we have eliminated the case in which there is a non-zero probability of a zero length service time. 




In this figure, b t is the probability that the customer leaves after the i' h stage and Cl- (—1 — b- j is the probability 
that the customer goes to the next stage. Given that a customer reaches the / th stage the service time in this stage has a 
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negative exponential distribution with mean ly /./ . Since the service time distribution for a stage is exponential, when 

describing the state of the network of service stations it is not necessary to know the exact amount of service a customer 
has received at a service center; the stage of service is sufficient. 

In [4], Chandy terms these the global balance equations. He defines another type of balance equation which he 
calls the local balance equations. Informally, a local balance equation equates the rate of flow into a state by a customer 
entering a stage of service to the flow out of that state due to a customer leaving that stage of service. We associate a 
customer with a stage of service in the following ways. If the customer is in service at a service center, then he is in one of 
the stages of his service time distribution at that service center. If the customer is queued at a service center, then he is in 
the stage of his service time distribution he will enter when next given service. 

The local balance equations are sufficient conditions for global balance, but they are not necessary. Local balance 
requires, that each term on the right-hand side of a global balance equation be equal to a particular subset of terms on the 
left-hand side of that global balance equation. 

To illustrate the concept of local balance we consider the relatively simple network model in Figure. 2. 

This is a closed network with two classes of customers (which we refer to as class 1 and class 2). There are N\ 
class 1 customers and IV 2 class 2 customers in the networks. All service times are exponentially distributed and 

( / = 1, 2, T = 1, 2) is the mean service time for a class r customer at service center i. 

Mir 




Type 2 

service center 2 



Type 3 

service center 1 



Figure 2 



In this example P , 



1,2:2,2 



2, 2:1,2 



P 



: 1 P + P 



= 1 . 



Let Tl i be the number of class r customers at service center i. For convenience we write the global and local 
balance equations only for the states in which Yl- >0, i = 1, 2, T — 1, 2 . 

Global Balance Equation: 
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Local Balance Equations: 
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( 2 . 1 ) 



( 2 . 2 ) 



Since all the service time distributions in this, example are exponential the current stage of service of a customer 
is uniquely defined by the customer's class and the current service center. Local balance equation (i,r) for j = 1, 2, r = 1, 2 

equates the rate of flow out of state ^n ll ,n l2 ,n 2l ,n 22 ) due to a class r customer leaving service center i with the rate of 

flow into state (n u ,n n ,n 2V n 22 ) due to a class r customer entering service center i. 

As in this example it is generally true that each global balance equation is the sum of a sub-set of the local balance 
equations. Thus a solution for the local balance equations is automatically a solution to the global balance equations. In 
many cases the local balance equations are inconsistent and therefore have no solution. For example if there is FCFS 
scheduling at a service center and different classes of customer have different service time distributions the local balance 
equations are inconsistent. 

The value of the local balance concept is that (1) it leads to a simpler and more organized search for solutions for 
equilibrium state probabilities and (2) it works for a large number of cases (in fact for virtually all of the closed form 
solutions known for general classes of networks of queues— although not many interesting cases have known solutions). 



solution. 



Before presenting the solution to the class of networks described, we define a set of terms that appear in the 
For a customer of class r, let j e j < j < ^v} be a solution to the following set of equations. 

Z e ir P i,nj,s +d js= e js’ 1 
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The value of d - s is determined by the arrival process of customers of class s to service center j. If there are no 
such arrivals from outside the system, then d = () . If there are such arrivals then d js = Cj ; ■ In a closed system there are 

no arrivals to any center and all the d j s are zero. In this case 6 [r is the relative frequency of visits to service center i by 
customers of class r. 

Note that a system may be “open” with respect to some classes of customers and “closed” with respect to other 
classes of customers. Our solution applies to this class of system. 

One further definition is required. If at the / th service center the r lh class of customers has a service time 
distribution that is represented as a network of stages then this is represented as illustrated in figure 3. 




The first subscript on a, b and jU denotes the service center. The second subscript denotes the class of customer 
and the third subscript denotes the stage. 



Let 



A Jl ( 



Theorem 

Given a network of service stations which is open, closed or mixed in which each service center is of type 1, 2, 3 
or 4. Then the equilibrium state probabilities are given by 

P{S — x l ,x 2 ,---,x N ) — Cd (5 , )/ 1 (-^ 1 )/ 2 ( -^2 ) * * * ./,v i x N ) 



where C is a normalizing constant chosen to make the equilibrium state probabilities sum to 1, d(S) is a function 
of the total number of customers in system and each /i is a function that depends on the type of service center i. 

If service center i is of type 1 then 



./;U)=n 

./■=! 



M,(j) 



If service center i is of type 2 then 
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If service center i is of type 3 then 
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If service center i is of type 4 then 

ft ( x i ) = ft 6ir > A ‘ r i 



If the arrivals to the system depend on the total number of customers in the system, M(S), and the arrivals are of 
class r and for center i according to fixed probabilities P lr then 

M(S)-1 

d(s)= n mo 

i = 0 

If we have the second type of state dependent arrival process then 

m M(Ej)-l 

d(s)=ii n aw 

M i= 0 

If the network is closed then d(S) = 1 . 

The theorem is proved by checking that the local balance equations are satisfied. In every case for which these 
results apply the local balance equations reduce to the defining equations for the { ■ 



Simplification of Results 

The solution presented for the equilibrium state probabilities deals with system states that are more detailed than 
is usually required. The more detailed states are necessary to derive the equilibrium state probabilities. Now we define the 
system state as the number of each class of customer in each service center. More formally state S of the system is given by 

(y v y^,...,y N ) where y. =( fl ; l , ftir ) and n ir is the number of customers of class r in service center i. Let n, 

1 

be the total number of customers at service center i and let be the mean service time of a class r customer at service 

Mir 

center i. Then the equilibrium state probabilities are given by 

= ()>!, y 2 .-> } ; i V )) = c^(5)g 1 (} ; i)g 2 (}' 2 )...^(^) 



where 

if service center i is of type 1 then 



8,(y.) 





i 

Mj) 



if service center i is of type 2 or 4 then 
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r = 1 n ir ■ L "ir 



if service center i is of type 3 then 






In each case the expression for is derived by summing /' ( X - ) overall X i with , /l j2 H jk 

fixed. That this is the correct definition of the g ; follows from the product form of the solution given 

The evaluation of the normalizing constant requires summing the given expression for the equilibrium state 
probabilities over all feasible states. In the next section we show a closed form solution for C for an open network in which 

fl, ( /77 ) = H l for all m if service center i is of type one. 

Open Systems 

For open systems it is possible to obtain a closed form solution for the normalization constant when the arrival 
process is of the first type and A ( M (S)) = ^ = constant. Since the system is open any number of customers is 
feasible at a service center. 

Therefore 



«i =0 n 2 =0 n N =0 V i=l 



c -‘= £A n %(n 2 ) ...I Y^r N h N (n N ) 



I»<) = 

n,= 0 V reR, /L 



if service center i is type 1 and fl- ( II - ) = M, 



V rety t^ir 



if service center i is type 2 or 4 



y A-fin 

reR: Mr 



if service center i is type 3 



Marginal Distribution at a Service Center in an Open System 



Let F (n ; .) be the equilibrium probability that there are n, 



customers at service center i. 
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Using the expression for C, we reduce this to 

m=0 



3 fa) 



Let 



^ Hi 



if service center i is type 1 . 



a = Z a 

reRj 



Hi, 



if service center i is type 2, 3 or 4. 



Then P. (ji ( ) = (l — /? ) pH if service center i is type 1, 2 or 4. 

Pi"‘ 

-Pi— 

— e '' if service center i is type 3. 

These results provide a convenient way of examining the equilibrium distribution at a service center. For type 1, 2 
or 4 service stations the marginal distribution is the same as the distribution of the number of customers in an M I M 1 1 

queue with a suitably chosen utilization, yC> . For the equilibrium solution to exist each yC> is required to be less than 1 . 

The marginal distribution for a type 3 service center is the same as the equilibrium distribution for the number of 

A 

customers for an M / G / °° system with p — This certainly appears to be reasonable since for an open properties of 

H 

network models that satisfy local balance. 

All of the network models that we have treated in this paper can be shown to be equivalent to models in which all 
classes of customers have the same exponential service time distribution at a given service center. Thus an exponential 

service time distribution with mean _j_ may be associated with the / th service center and all classes of customers have this 

H, 

service time distribution at the / th service center. This fact suggests the conjecture that a necessary condition for local 
balance to be satisfied for a given model is that there exist an equivalent model in which different classes of customers may 
have different transition probabilities but all classes of customers have the same exponential service time distribution at a 
given service center. 

The method of making these transformations to the model is straight-forward and will be illustrated by example 
rather than a formal description of the general case. 

Consider a general service time distribution represented by a network of stages as in Figure 1 . Let this represent 
the service time distribution for a customer in class r in service center i. We introduce n new customer classes denoted by 
r\, r 2 ,...,r„ which correspond to the stages in this network and delete customer class r. 
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The service time of a class T. customer will be exponential with mean ( J < / < yi ) . The transition 

Me 

probabilities for a class T f customer are defined as: 

Pi ,r t ;j,s = £ P hr .j' S 
Pi ,r t \i,r M =a t 1 <i<n 

To take care of the transitions into class r in the original model we require that all transitions into state r be 
redefined as transitions into state r x . These transition probabilities are defined as: 

P , = P . , j,S 

With this transformation of the model a customer will have the same distribution of total time at a service center 
and will have the same transition probabilities from service center to service center. 

After performing this transformation for each customer class with a general service time distribution we have a 

1 

model in which all service time distributions are exponential. Suppose that is the mean service time of a class r 

Mu 

customer at service center i. Let 

Mi = max \_M it ] 



1 

We redefine the mean service time for each class of customers at service center i to be . Now we redefine the 

Mi 

transition probabilities out of service center i, 

M,r 



Let P = 1 



Mi 



Then define 

P' . =p +(1 -p )P 

p' . =(l -p )p . 

i,r,j,s \ * r / i,r,j,s 

The effect of these new transition probabilities is to cause a class r customer to be fed back (or to revisit) service 
center i a random number of times. Each time the class r customer enters service center i his service time is exponentially 

distributed with mean _L . The number of visits the class r customer makes to service center i (between transitions in the 
Mi 
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1 

original model) is geometrically distributed with mean . It is easily shown that the total service time of the class r 

1 P r 



customer at service center i is exponentially distributed with mean 



f 1 ) 

V 1 Pr > 



1 






[8]. Therefore we have not 

Mt, r 



changed the total service time distribution for this customer at service center i. 

After completing these transformations throughout the model we have an equivalent model with the desired 
characteristics. 



CONCLUSIONS 



The transformations that we have made to the original model preserved the original distributions of service time 
that a customer requires at a service center. However a customer does not spend that time on the server in one contiguous 
interval. We required a customer to make extra transitions in which he leaves and reenters the service center. It is clear that 
with type 2, 3 or 4 service centers this does not affect a customers service. For type 1 service centers the transformed 
model would not be equivalent to the original model since a customer who leaves the service center and reenters will now 
be at the end of the queue. Of course we have from the beginning required that at type 1 service centers all customers have 
the same exponential service time distribution so that such a service center does not require any modification. 
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